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^ 1 Introduction 

u: Modern variational analysis is based on variational principles and techniques applied to optimization-related 
I and equilibrium problems as well as to a broad spectrum of problems, which may not be of a variational 
(~| ' nature; see the books [TJ |H1 IHl IS] for more discussions and references. In this vein, extremal principles 
. have been well recognize as fundamental geometric tools of variational analysis and its applications that 
can be treated as far-going variational extensions of convex separation theorems to systems of nonconvex 
sets. We refer the reader to the two-volume monograph [8, 9 and the bibliographies therein for various 
developments and applications of the extremal principles in both finite and infinite dimensions. 
^ ^ To the best of our knowledge, extremal principles have been previously developed only for finite systems 

' of sets. On the other, there is a strong demand in various areas (e.g., in semi- infinite optimization) for 
their counterparts involving infinite, particularly countable, set systems. 

The first attempt to deal with infinite systems of sets was undertaken in our recent papers |101 lllj , 
' where certain tangential extremal principles were established for countable set systems and then were 
, applied therein to problems of semi-infinite programming and multiobjective optimization. At the same 
time, the tangential extremal principles developed and applied in [lOl [11] concern the so-called tangential 
extremality (and only in finite dimensions) and do not reduce to the conventional extremal principles of 
[5] for finite systems of sets even in simple frameworks. 
' In this paper we develop new rated extremal principles for both finite and infinite systems of closed sets 

$H ■ in finite-dimensional and infinite-dimensional spaces. Besides being applied to conventional local extremal 
points of finite set systems and reducing to the known results for them, the rated extremal principles 
provide enhanced information in the case of finitely many sets while open new lines of development for 
countable set systems. The results obtained in this way allow us, in particular, to derive intersection rules 
for generalized normals of infinite intersections of closed sets, which imply in turn new necessary optimality 
conditions for mathematical programs with countable constraints in finite and infinite dimensions. 

The rest of the paper is organized as follows. In Section 2 we briefly discussed preliminaries from vari- 
ational analysis and generalized differentiations used in the sequel. In Section 3 we introduce the notion of 
rated extremality and derive exact and approximate versions of the rated extremal principles for systems 
of finite sets in finite-dimensional and infinite-dimensional spaces. Section 4 is devoted to rated extremal 
principles for infinite/countable systems of closed sets in Banach spaces. Finally, Section 5 provides appli- 
cations of the rated extremal principles to calculus of generalized normals to infinite set intersections, which 
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implies necessary optimality conditions for optimization problems with countable geometric constraints. 

Our notation is basically standard in variational analysis; see, e.g., [8l[l3]. Recall that B{x,r) stands 
for a closed ball centered at x with radius r > 0, that IB and IB* are the closed unit ball of the space in 
question and its dual, respectively, and that IN := {1,2, . . .}. Given a set-valued mapping F: X =^ X* 
between a Banach space X and its topological dual X*, we denote by 



LimsupF(a;) := Ix* e X* e Y 

T. — VT. ^ 



3 sequences Xk ^ x and xt^x* as /c — )■ oo 

. (1-1) 

such that xl G F{xk) for all k e IN > 



the sequential Painleve-Kuratowski outer limit of F at x, where w* signifies the weak* topology of X*. 



2 Preliminaries from Variational Analysis 

In this section we briefly overview some basic tools of variational analysis and generalized differentiation 
that are widely used in what follows; see the books pQ |H1 131 III] for more details and references. Unless 
otherwise stated, all the spaces under consideration are Banach with the norm || • || and the canonical 
pairing (•, •) between the space in question and its topological dual. 

Let be a nonempty subset of a space X. Given s > 0, the set oj e -normals to at x is given by 

N,{x- 0) := J X* e X* limsup ^^f'''",^^ < e I (2.1) 

with N^{x; 0) if x ^ 0. When e = 0, the set (HD) is denoted by iV(x; 0) := iVo(x; 0) and is called 
the Frechet normal cone (or prenormal/ regular normal cone) to at x. The Mordukhovich/basic/limiting 
normal cone to at a point x € is defined by 

iV(x;0) Limsup iVe(x;0) (2.2) 

via the sequential outer limit Painleve-Kuratowski outer limit (jl.l[) of e- normals (j2.1l) as x — > x and e J, 0. 
If the space X is Asplund (i.e., each of its separable subspace has a separable dual that holds, in particular, 
when is reflexive) and the set is locally closed around x, we can equivalently put = in (|2.2p : see [5] 
for more details. If X = M", the basic normal cone (|2.2I) can be equivalently described as 



iV(x; 0) Limsup (cone [x - n(x; 0)] | (2.3) 

via the Euclidian projector n(x; 0) :— {w e 0| ||x — = dist (x; 0)} of x G R" onto 0, which was the 
original definition in [7] . In the above formula (|2.3p the symbol cone A stands for the cone generated by a 
nonempty set A and is defined by 

cone A := (J XA. 

A>0 

Given an extended-real-valued function ip: X ^ R := (— oo, oo], recall that the Frechet/regular subdif- 
ferential of at x with <p(x) < cx) is defined by 

d^(x):^\x*eX* liminf^(")'^f)~y'"-"^ >0|. (2.4) 
L x^x ||x — x|| J 

It is easy to see that 7V(x;0) = dS{x-0) for the indicator function S{-;0) of defined by S{x-0) 
when X e and S{x; 0) — oo otherwise. Furthermore, we obviously have the following nonsmooth version 
of the Fermat stationary rule: 

S dip{x) if X is a local minimizer of ip. (2-5) 
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A major motivation for our work is to devefop and apply extremal principles of variational analysis the 
first version of which was formulated in [6] for finitely many sets via e-normals ; see [3 Chapter 2] for 
more details and discussions. Recall [H Definition 2.5] that a set system {0i, . . . ,0m}, rn > 2, satisfies 
the approximate extremal principle at a: G H™ ]^0i if for every e > there are Xi € 0i H {x + elB) and 
X* e N{xi\ 0j) + elB* , i = 1, . . . , m, such that 

+ ...+<„ ==0 and \\xlf + . . . + \\x;J^ ^ 1. (2.6) 

If the dual vectors x* can be taken from the limiting normal cone N{x] then we say that the system 
{01, . . . , 0m} satisfies the exact extremal principle at x. 

Efficient conditions ensuring the fulfillment of both approximate and exact versions of the extremal 
principle can be found in [8j Chapter 2] and the references therein. Roughly speaking, the approximate 
extremal principle in terms of Frechet normals holds for locally extremal points of any closed subsets in 
Asplund spaces ([H Theorem 2.20]) while the exact extremal principle requires additional sequential normal 
compactness assumptions that are automatic in finite dimensions; see [8, Theorem 2.22]. 

Recall [51 |H] that a point x G n™i0i is locally extremal for the system {0i,...,0m} if there are 
sequences {aik} G X , i — I, . . . ,m, and a neighborhood U oi x such that aik — ?> as fc — > oo and 

m 

n (0» - a^k) n [/ = for aU large fc € IV. (2.7) 

i=l 

As shown in [8] , this extremality notion for sets encompasses standard notions of local optimality for 
various optimization-related and equilibrium problems as well as for set systems arising in proving calculus 
rules and other frameworks of variational analysis. 

3 Rated Extremality of Finite Systems of Sets 

In this section we introduce a new notion of rated extremality for finite systems of sets, which essentially 
broader the previous notion (|2.7|) of local extremality. We show nevertheless that both exact and approxi- 
mate versions of the extremal principle hold for this rated extremality under the same assumptions as in 
[5] for locally extremal points. Let us start with the definition of rated extremal points. For simplicity we 
drop the word "local" for rated extremal points in what follows. 

Definition 3.1 (Rated extremal points of finite set systems). Let 0i,...,0,„ as m > 2 be nonempty 
subsets of X , and let x be a common point of these sets. We say that x is a (local) RATED EXTREMAL 
POINT of rank a, < a < 1, of the set system {0i, . . . , 0m} if there are 7 > and sequences {oik} C X , 
i — I, . . . ,m, such that rk ■— max^ \\aik\\ as fc 00 and 

m 

n i&t - a^k) n B{x, 7r^) = for all large k&N. (3.1) 

i=l 

In this case we say that {0i, . . . , 0^} is a RATED EXTREMAL SYSTEM at x. 

The case of local extremality (|2.7p obviously corresponds to (|3.1I) with rate a = 0. The next example 
shows that there are rated extremal points for systems of two simple sets in R^, which are not locally 
extremal in the conventional sense of (|2.7|) . 

Example 3.2 (Rated extremality versus local extremality). Consider the sets 

01 := {(xi,X2) e M^l 2:2 - 2^1 < 0} and 02 := {(xi, 2:2) G R^| -a;2-a;i<0}. 

Then it is easy to check that (xi, X2) = (0, 0) G 0i n 02 is a rated extremal point of rank a 
system {0i, 02} but not a local extremal point of this system. 
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Prior to proceeding with the main resuhs of this section, we briefly discuss relationships between the 
rated extremality and the tangential extremality of set systems introduced in |10j . Let {0i, « = !,..., m}, 
m > 2, be a system of sets with x £ n™]^0i, and let A {Ai{x),i — 1, . . . ,m} be an approximating 
system of cones. Recall that a; is a A-tangential local extremal point of {0i,i — 1, . . . , m} if the system of 
cones {Ai{x), i = 1, . . . , m} is extremal at the origin in the sense that there are ai, . . . , Um € X such that 

m 

Pi (0, - a,) = 0. 

We refer the reader to [ini HI] for more discussion on the tangential extremality and its applications. 

The next proposition result and the subsequent example reveal relationships between the rated ex- 
tremality and tangential extremality of set systems. 

Proposition 3.3 (Relationships between rated and tangential extremality of finite systems of sets). Let 
{01, . . . , 0m} as m > 2 be a A-tangential extremal system of sets at x. Assume that there are real numbers 
C > 0, p € {0, 1) and a neighborhood U of x such that 

dist {x - x; Ai) < C\\x - x\\^^P for all xe&ifMJ and i = l,...,m. (3.2) 

Then {0i, . . . , 0m} is a rated extremal system at x. 

Proof. Since the general case of m > 2 can be derived by induction, it suffices to justify the result 
in the case of m = 2. Let {Ai, A2} be an extremal system of approximation cones and find by definition 
elements ai , 02 £ A^ such that 

(Ai - ai) n (A2 " aa) = 0. 

Without loss of generality, assume that ai — —02 =: a. Take a G (0, 1) with /3 := a{l + p) > 1 and show 
that for all small i > we have 

(01 - ta) n (02 + to) n B{x, lltoll") = 0. (3.3) 
Suppose by contradiction that there exists 

x e (01 - to) n (02 + to) n B{x, \\ta\\"). (3.4) 

That implies by using condition (13.21) that 

dist {x — x;Ai — ta) = dist {x + ta~ x; Ai) < C\\x + ta — x\\^^''' ^ 
dist {x - 5; A2 + ta) = dist {x-ta- x; A2) < C\\x -ta- 

Thus we have for some constant C that 

\\x + ta-x\\^+-P < C'max{||a;-5||,||ta||}^+'' < C'max{||to||'^, ||ta||i+?'} =o(||ta||) as UO 

and similarly ||a; — to — a;|| — o{\\ta\\). Put then d := dist (Ai — a, A2 + a) > and observe due the conic 
structures of Ai and A2 that 

td = dist (Ai - to; A2 +ta) > 
for alH > sufficiently small. Combining all the above gives us 

td — dist (Ai — to; A2 + to) < dist {x — x;Ai — ta) + dist {x — x; A2 + ta) — o{\\ta\\), 

which is a contradiction. Thus {0i, 02, x} is a rated extremal system at x with rank a chosen above. This 
completes the proof of the proposition. □ 

One of the most important special cases of tangential extremality is the so-called contingent extremality 
when the approximating cones to 0; are given by the Bouligand-Severi contingent cones to this sets; see 
[10[ 111] , where this case of tangential extremality was primarily studied and applied. The following example 
(of two parts) shows that the notions of rated extremality and contingent extremality are independent from 
each other in a simple setting of two sets in M^. 
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Example 3.4 (Independence of rated and contingent extremality). Let X — M."^, and let x — (0, 0). 
(i) Consider two closed sets in given by 



epi/ and 02 



X ]R_ \ int0i, 



where f{x) := xsm^ for x e M with /(O) :— 0. It is easy to see that the contingent cones to 0i and 02 
at X are computed by 

Ai=epi(-|-|) and A2=IRxM^. 

We can check that the set system {0i, 02} is locally extremal at x, and hence a; is a rated extremal point 
of this system of sets with rank a = 0. On the other hand, the contingent extremality is obviously violated 
for {01, 02} at X as follows from the above computations of Ai and A2. 
(ii) Now we define two closed sets in by 

1 



01 :=: 



and 02 := epi with f{x) := -x^"^'"" 1^1 for x^O and /(O) := 0. 



The contingent cones to 0i and 02 at x are easily computed by Ai 



and A2 



We can 



check that x is not a rated extremal point of {0i, 02} whenever a € [0, 1), while the contingent extremality 
obviously holds for this system at x. 

The next theorem justifies the fulfillment of the exact extremal principle for any rated extremal point 
of a finite system of closed sets in R". It extends the extremal principle of [51 Theorem 2.8] obtained for 
local extremal points, i.e., when a = in Definition 13.11 



Theorem 3.5 (Exact extremal principle for rated extremal systems of sets in finite dimensions). Let x be 
a rated extremal point of rank a G [0, 1) for the system of sets {0i, . . . , 0m} as m> 2 in R". Assume that 
all the sets &i are locally closed around x. Then the exact extremal principle holds for {0i, . . . , 0m} o^t x, 
i.e, there are x* e N{x] &i) for i = 1, . . . , to satisfying the relationships in p.6p . 

Proof. Given a rated extremal point x of the system {0i, . . . , 0m}, take numbers a G [0, 1) and 7 > 
as well as sequences {oife} and {r^} from Definition [3TTJ Consider the following unconstrained minimization 
problem for any fixed k G IN: 



minimize dk {x) 



^dist^( X + Oik] &i) 



,i=i 



+ 



\\x - x\\ 



, X G 



7' 



(3.5) 



Since the function dk is continuous and its level sets are bounded, there exists an optimal solution Xk to 
p.5[) by the classical Weierstrass theorem. We obviously have the relationships 



dk{xk) < dk{x) = 
which readily imply the estimate 



y^dist^(a; + o»fc;0») 



i=l 



< 



El 

.1=1 



< rfcVTO, 



-^\\xk - x\\°: < rkA/m, i.e., \\xk - x\\ < jrk ■ 
7° 



Taking the latter into account, we get 



i^k ■= 



^dist^(a:fe + aik;0i) 



> 0, 



since the opposite statement Vk — contradicts the rated extremality of x. Furthermore, the optimality of 
Xk in (|3.5|) and choice of {aik} give us the relationships 



dkixk) = Vk^ ^||a;fc - x\ 



< 



I as fc — )• 00, 
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which ensure in turn that Xk — >■ x and z^fc J, as fc — >■ oo. 

We now arbitrarily pick Wik e Il{xk + aik] Qi) for i = 1, . . . , m in the closed set 0i and for each k £ IN 
consider the problem: 

zeR", (3.6) 

which obviously has the same optimal solution x^ as for (j3.5p . Since Vk > ^ and the norm || • || is Euclidian, 
the function pk{-) in (|3.6p is continuously differentiable around Xk- Thus applying the classical Fermat rule 
to the smooth unconstrained minimization problem p.6p . we get 

m 

El — 2a 
^ik + C!\\xk — x\\ a (xk — x) = for some constant C, 

where x*f. := (xk + aik — Wik)/ Vk for i — 1, ... ,171 with 

\\xlkf + --- + \\xlkf = ^- 

Observe that \\xk — x\\~°~{xk — x) — \\xk — x\\~°~ — — > as Xfc — >■ x. Due to the compactness of 

\\xk - x^ 

the unit sphere in R", we find x* e R" as i = 1, . . . , m such that a;*^, x* k co without relabeling. 
It follows from the equivalent description (|2.3p of the limiting normal cone that x* S N[x\(di) for all 
i = 1, . . . , m. Moreover, we get from the constructions above that 

\\x\f- + . . . + = 1 and X* + . . . + = 0. 

This gives all the conclusions of the exact extremal principle and completes the proof of the theorem. □ 
The next example shows that the exact extremal principle is violated if we take a = 1 in Definition 13. II 

Example 3.6 (Violating the exact extremal principle for rated extremal points of rank a = 1). Define 

two closed sets in R^ by 

01 := epi(-|| • II) and 02:=RxR^. 

Taking any | 0, we see that 

(01 + (0, flfe)) n (01 - (0, flfe)) n B{x, ak/2) = 0, 

i.e., X = (0,0) is a rated extremal point of {0i,02} of rank a — \. However, it is easy to check that the 
relationships of the exact extremal principle do not hold for this system at x. 

Observe that Example 13.61 shows that the relationships of the approximate extremal principle are also 
violated when a = 1. However, for rated extremal systems of rank a G [0, 1) the approximate extremal 
principle holds in general infinite-dimensional settings. Let us proceed with justifying this statement 
extending the corresponding results of obtained for the rank a = in Definition 13.11 

Theorem 3.7 (Approximate extremal principle for rated extremal systems in Frechet smooth spaces). 
Let X he a Banach space admitting an equivalent norm Frechet differentiable off the origin, and let x he a 
rated extremal point of rank a G [0, 1) for a system of sets 0i, . . . , 0„i locally closed around x. Then the 
approximate extremal principle holds for {0i, . . . , 0m} at x. 

Proof. Choose an equivalent norm || • || on X differentiable off the origin and consider first the case 
of m = 2 in the theorem. Let a; S 0i n 02 be a rated extremal point of rank a € [0, 1) with 7 > taken 
from Definition 13. II Denote r := max{||ai||, ||a2||} and for any e > find 01,02 such that 

r'-'^<rnin{l '^^ } and (0i - ai) H (02 - a2) H B(x, 7r") = 0. 



minimize pk{x) :- 



E 

.i=l 



\\x + Oik - Wik\^' 
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We also select a constant C > with (^)" ~ and denote /3 := ^ > 1. Define the function 

(p{z) :— II {xi — fli) — {x2 — 02)11 for z = {xi,X2) E X x X (3.7) 

with the product norm ||z|| := (||a;i|p + ||a;2|p)"'^/^ on X x X , which is Frechet differentiable off the origin 
under this property of the norm on X. Next fix zq = {x, x) and define the set 

W{zo) := {z e 01 X 02\ipiz) + C\\z- zof < 'p{zo)} , (3.8) 

which is obviously nonempty and closed. For each z = {xi, X2) G W{zo) we have i = 1,2: 

C\\x^ - x\f < C\\z - z||'^ < ip{zo) = II - ai + a2|| < 2r, 1, 2, 

which implies that \\xi — x\\ < (^)^ = {^)°' r" = ^r" and thus 

W{zo) C B(x,7r") X B{x,-fr") C B{x,^e^) x B{x,^e^). 

It follows from Definition 13.11 and constructions p. 71) and p.8p that i^(z) > for all z G VF(xo). Indeed, 
assuming on the contrary that (p{z) = for some z = (xi,X2) G W{xo) gives us 

||xi - ai - x|| < ||a;i - x|| + ||ai|| < ^r" + r = (^ + r^"") < jr" 

and thus .ti — oi = 2:2 — 02 G (0i — ai) H (02 — 02) n -8(5;, jr") 7^ 0, a contradiction. 

Hence is Frechet differentiable at any point z G W{zo). Pick any zi G 0i x 02 satisfying 

(^(zi) + C||zi - zo\f < ^nf ^ {(^(z) + C||z - zoll^} + ^ 
and define further the nonempty and closed set 



W^(zi) |z G 01 X 02| ifiiz) +C\\z- zoll^ + C^^^ < (^(zi) + C||zi - zof 
Arguing inductively, suppose we have chosen Zk and constructed W(zfe), then pick z^+i G W{zk) such that 



^(z.,i) + c t ^^±i-i^ < M {^(z) + C t ■ 



/3 • 



i=0 ^ ' i=0 



and construct the subsequent nonempty and closed set 

:= |z G 01 X 02| ^(z) + < ^(^.+1) + ^^±i-i^| . 

It is easy to see that the sequence {W^(zfe)} C 0i x 02 is nested. Let us check that 

diamM^(zfc+i) := sup {||z — wll I z,!*; G VF(zfc+i)} — > as k-^00. (3.9) 
Indeed, for each z G P^(zfe+i) and k E IN we have 



2fe+i 

1=0 \ 1=0 

1 1 1 1 o 



1=0 ^ ' 1=0 
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which imphes that diamW (zk+i) < 2 ^ ^^^ ^ ^ and thus justifies p. 91) . Due to the completeness of X the 

oo 

classical Cantor theorem ensures the existence of z = {xi,X2) S W{zo) such that W{zk) — {z} with 

fe=0 

Zfc — > z as fc ^ oo. Now we show that 2 is a minimum point of the function 

00 II _ ||/3 

<^(z):=^(z)+c5:^^ (3.10) 

i=0 

over the set 0i x 02. To proceed, take any z ^ 2: e 0i x 02 and observe that z ^ W{zk) for all fc G JV 
sufficiently large while z G W(zk)- This yields the estimates 

0(z) > ^(z) + > ^(,,) + c X: > ^{-z) + C ^ 

1=0 i=0 1=0 

and hence justifies the claimed inequality 0(z) > 0(z) by letting fc — ^ 00. 

We get therefore that the function (p{z) + 6{z; 0i x 02) attains at z its minimum on the whole space 
X X X. The generalized Fermat rule (|2.5I) gives us the inclusion G d(^(f){z) + S{z; @i x 02)) . Since ^p{z) > 
and the norm || • ||^ is smooth, the function in (I3.10p is Frechet differentiable at z. Applying the sum rule 
from |8l Proposition 1.107], the Frechet subdifferential formula for the indicator function, and the product 
formula for Frechet normal cone p.ip from [H Proposition 1.2], we get 

-V0(z) = -K, u*) G iV(z; 01 X 02) = N{xi; 0i) x N{x2; 02), 

where the dual elements u* , i = 1,2, are computed by 

* , * \\xi ~ xijW'^-'^ ^ * , * 11^2 - a;2j|l''"^ 

"1=^ +z^"^ij — ^"""^ u2 = -x +2^w2j ^ — 

j=0 j=0 

with Zj = {xij,X2j), X* ^ V(|| • ||)((ii - ai) - (^2 - 02)), and 

fv(|| • \\){x^ - Xij) if X, - 7^ 0, 
I otherwise. 

for i = 1, 2 and j — 0, 1, . . . due to the construction of the function (p in p.lOp . Observing further that 
= 1 and that z, Zi G W{zo) gives us 

\\xi - x.ij\\ < = ei^, 

which implies the estimates \\xi — Xij\\^~^ < e and 

Ell * II W^i ~ ■'^ij 11^ ^ o • -,0 

\\w^J\\ <2e, 1 = 1,2. 

Setting finally xl := —x*/2, X2 x* /2, and Xi := Xi for i = 1, 2, we arrive at the relationships 

X* G N{xi; Qi) + eB* , Xi G B{x, e) for i = 1, 2, 
ll^^ill + 11^211 — 1, and xl + X2 = 0, 

which show that the approximate extremal principle holds for rated extremal points of two sets. 

Consider now the general case of m > 2 sets. Observe that if a; as a rated extremal point of the system 
{01, . . . , 0m} with some rank a G [0, 1), then the point z := {x, . . . ,x) G X^^^ is a local rated extremal 
point of the same rank for the system of two sets 

01 := 01 X ... X 0„_i and 62 := {(x, . . . ,x) G X"-i|a; G 0™}. (3.11) 
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To justify this, take numbers a G [0, 1) and 7 > and the sequences (aife, . . . , amk) from Definition 13 . 1 1 for 
m sets and check that 

(Si - (aife, . . . , an-i,k)) n (62 - (a„fc, . . . , a„fe)) n B{{x, x); 7r^) = (3.12) 

with rfe := max{||aifc||, . . . , ||a„fe||}. Indeed, the violation of p.l2p means that there are (2:1, . . . ,x„_i) G 
01 X ... X 0„_i and Xm & 0m satisfying 

which clearly contradicts the rated extremality of x with rank a for the system {0i, . . . , 0m}- Applying 
finally the relationships of the approximate extremal principle to the system of two sets in (j3.1ip and 
taking into account the structures of these sets as well as the aforementioned product formula for Frechet 
normals, we complete the proof of the theorem. □ 

The next theorem elevates the fulfillment of the approximate extremal principle for rated extremal 
points from Frechet smooth to Asplund spaces by using the method of separable reduction; see [31 [S]. 

Theorem 3.8 (Approximate extremal principle for rated extremal systems in Asplund spaces). Let X be 
an Asplund space, and let x be a rated extremal point of rank a € [0, 1) for a system of sets 0i, . . . , 0m 
locally closed around x. Then the approximate extremal principle holds for {0i, . . . , 0m} at x. 

Proof. Taking a rated extremal point x for the system {0i, . . . , 0m} of rank a G [0, 1), find a number 
7 > and sequences {a^fe}, i = l,...,m, from Definition 13.11 Consider a separable subspace Yq of the 
Asplund space X defined by 

Yq :— spanjai, Oik \ i — 1, . . . ,m, k £ IV} . 

Pick now a closed and separable subspace Y C X with Y D Yq and observe that a; is a rated extremal 
point of rank a for the system {0i CiY, . . . , 0m H Y}. Indeed, we have 

((0inr)-aife) n...n ((0„nr)-a„fc) nSy(a;;7r^) 

C (01 - aifc) n . . . n {&m - flmfc) n Bx{x; 7r^) = 0, 

where max{||an;||, . . . , ||a„ife||}, and where Bx and By are the closed unit balls in the space X and 

y, respectively. The rest of the proof follows the one in [8l Theorem 2.20] by taking into account that Y 
admits an equivalent Frechet differentiable norm ofi^ the origin. □ 

We conclude this section with deriving the exact extremal principle for rated extremal systems of rank 
a € [0, 1) in Asplund spaces extending the corresponding result of [S] Theorem 2.22] obtained for a = 0. 

Recall that a set Q <Z X is sequentially normally compact (SNC) at a; e if for any sequence 
{{xk,x*f.)}keiN C X X* we have the implication 

[xk ^ 4 ^ with 4 e N{xk;&), ke]N]=^ ||4|| -^0 as k ^ 00. (3.13) 

Besides the obvious validity of this property in finite-dimensional spaces, it holds also in broad infinite- 
dimensional settings; see, in particular, [8] Subsection 1.2.5] and SNC calculus rules established in [8l 
Section 3.3] in the framework of Asplund spaces. 

Theorem 3.9 (Exact extremal principle for rated extremal systems in Asplund spaces). Let X be an 
Asplund space, and let x be a rated extremal point of rank a S [0, 1) for a system of sets 0i, . . . , 0„i locally 
closed around x. Assume that all but one of the sets @i, i = l,...,m, are SNC at x. Then the exact 
extremal principle holds for {0i, . . . , 0m} o^t x. 

Proof. Follows the lines in the proof of [81 Theorem 2.22] by passing to the limit in the relationships 
of the rated approximate extremal principle obtained in Theorem 13.81 □ 
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4 Rated Extremal Principles for Infinite Set Systems 



This section concerns new notions of rated extremality and deriving rated extremal principles for infinite 
systems of closed sets. The main results are obtained in the framework of Asplund spaces. 

Let us start with introducing a notion of rated extremality for arbitrary (may be infinite and not even 
countable) systems of sets in general Banach spaces. We say that : R+ R+ is a rate function if there 
is a real number AI such that 

rR{r) < M and limi?(r) = cx). (4.1) 

ri.0 

In what follow we denote by |/| the cardinality (number of elements) of a finite set /. 

Definition 4.1 (Rated extremality for infinite systems of sets). Let {0i}igT be a system of closed subsets 
of X indexed by an arbitrary set T, and let x € nteT®*- Given a rate function R{-), we say that x is an 
i?-RATED EXTREMAL POINT of the system {0i}igT */ there exist sequences {aik\ C X , i & T and k € IN, 
with rk '■— supjgT^ lloifcll ^0 as fc — > cx) such that whenever k £ IN there is a finite index subset Ik (1 T of 
cardinality \Ik\^^^ — o{Rk) with Rk :— R{rk) satisfying 

n (0z - a,k) n B{x; rkRk) = for all large k. (4.2) 

In this case we say that {0i}igT is an i?-RATED EXTREMAL SYSTEM at x. 

It is easy to see that a finite rated extremal system of sets from Definition 13.11 is a particular case 
of Definition 14.11 Indeed, suppose that a; is a rated extremal point of rank a € [0, 1) for a finite set 
system {0i, . . . , 0m}, i.e., condition (|3.ip is satisfied. Defining R{r) :— , we have that rR{r) — >■ and 
R{r) — > oo as r — 0; thus R{-) is a rate function while condition (14.21) is satisfied. 

Let us discuss some specific features of the rated extremality in Definition 14.11 for the case of infinite 
systems. For simplicity we denote R = R{r) in what follows if no confusion arises. 

Remark 4.2 (Growth condition in rated extremality). Observe that, although {0i}igT is an infinite 
system in Definition 14.11 the rated extremality therein involves only finitely many sets for each given 
accuracy £ > 0. The imposed requirement \I\'^/'^ = o(i?) guarantees that grows slower than R, which 

is very crucial in our proof of the extremal principle below. In other words, the number of sets involved 
must not be too large] otherwise the result is trivial. We prove in Theorem 14.61 that the rate |/|'^/^ = o{R) 
ensures the validity of the rated extremal principle, where the number r measures how far the sets are 
shifted. 

Define next extremality conditions for infinite systems of sets, which we are going to justify as an 
appropriate extremal principle in what follows. These conditions are of the approximate extremal principle 
type expressed in terms of of Frechet normals at points nearby the reference one. 

Definition 4.3 (Rated extremality conditions for infinite systems). Let {0i}igT &e o, system of nonempty 
subsets of X indexed by an arbitrary set T, and let x e {^t^T®^- ^'^V ^^^^ system {&i\i£T 

satisfies the rated extremal principle at x if for any e > there exist a number r € (0,e), an 
finite index subset I C T with cardinality \I\r < e, points Xi G 0i D B{x,e), and dual elements € 
N{xf, 0,) + rB* foriel such that 

J2x*=0 and = 1. (4.3) 

Observe that when a system consists of finitely many sets {0i, . . . , 0m} with |/| — m, we put the other 
sets equal to the whole space X and reduce Dcfinition l4.1l in this case to the conventional conditions of the 
approximate extremal principle for finite systems of sets; see Section 2. 

Now we address the nontriviality issue for the introduced version of the extremal principle for infinite 
set systems. It is appropriate to say (roughly speaking) that a version of the extremal principle is trivial 
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if all the information is obtained from only one set of the system while the other sets contribute nothing; 
i.e., if y * = G N{xi; 0i) for all but one index i. This issue was first addressed in [10], where it has been 
shown that a "natural" extension of the approximate extremal principle for countable systems is trivial. 

The next proposition justifies the nontriviality of the rated extremal principle for infinite set systems 
proposed in Definition 14.31 

Proposition 4.4 (Nontriviality of rated extremality conditions for infinite systems). Let {0i}igT be a 
system of set satisfying the extremality conditions of Definition 14.31 at some point x € HteT ^i- Then the 
rated extremal principle defined by these conditions is nontrivial. 

Proof. Suppose on the contrary that the rated extremal principle of Definition |4?3l is trivial, i.e., there 

is io e T (say io ~ 1) and y* e X* a.s i e T such that 

X* e y* + rB* C N{x^; 0^) + rJB* for ah i e I, 

X* 0, ^ ||a;*||^ = 1, and y* = whenever i e / \ {1} 
iei iei 

in the notation of Definition 14.11 It follows that ||x*|| < r for alH G / \ {1} implying that 

Vi + '^x*^\<r and ||yi|| < \I\r. 

Thus we arrive at the relationships 

E IKII' < (112/1 II +rr+J2''< \I\'r' + 2\I\r' + r' + (|/| - l)r' <Cs' iO 

as e 4, 0, a contradiction. This justifies the nontriviality of the rated extremal principle. □ 

Observe further that the extremal principle of Definition l4.3l mav be trivial is the rate condition \I\r < e 
is not imposed. The following example describes a general setting when this happens. 

Example 4.5 (The rate condition is essential for nontriviality). Assume that the condition \I\r < e is 
violated in the framework of Definition 14.31 Fix z/ > 0, suppose that / = {1, . . . , N} with Nr > v, pick 
some u* G iV(xi; 0i) with the norm ||-u*|| = z/, and define the dual elements 

7/* ^ 

x\ ■.^u*- — eN{xi;0i)+rB*, 

:= - — G N{x^■, 0,) + rB* for all i = 2,...,N. 
Then we have the relationships 

xl + ... + x%^0 and \\xlf + ... + \\x%f > — , 
which imply the triviality of the rated extremal principle by rescaling. 

Now we are ready to derive the main result of this section, which justifies the validity of the rated 
extremal principle for rated extremal points of infinite systems of closed sets in Asplund spaces. 

Theorem 4.6 (Rated extremal principle for infinite systems). Let {0i}igT be a system of closed sets in an 
Asplund space X , and let x be a rated extremal point of this system. Then the rated extremality conditions 
of Definition \A.3\ are satisfied for {0i}igT o-t x. 

Proof. Given e > 0, take r = supj ||ai|| sufficiently small and pick the corresponding index subset 
I — {1, . . . ,N} with TV'^/^ = o{R) from Definition 14.11 Consider the product space X^ with the norm of 
z = {xi,...,xn) ^ X'^ given by 

iizii ■.= i\\x^r+...+\\x^r)i 
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and define a function ip: ^ M. by 

(^J\(x,-a^)-ix.-a,)r^ ■ (4.4) 

To proceed, denote z := {x , x , . . . , x) € 0i x . . . x jy and form the set 

:= (01 X . . . X 0Ar) n (^B{x, {R - l)r) x ...x B{x, {R - l)r)) , (4.5) 

which is nonempty and closed. We conchide that (p{z) > for all z G W. Indeed, suppose on the contrary 
that ip{z) = for some z = {xi, . . . ,xn) € W and get by the estimates ||xi — ai — x\\ < \\xi — x\\ + \\ai\\ < 
(i? — l)r + r = Rr the relationships 

N 

Xi — ai = . . . = xn — ajy e (0i — tti) n B{x, Rr) ^ 0, 

1=1 

which contradict the extremality condition (|4.2I) . Observe further that 

1 

/ N \ 2 



¥j(z) = [ ^ ||ai -a^lp j <2ry/N< ig^ip{z) + 2rN 



\i=2 



Now we apply Ekeland's variational principle (see, e.g., [5J Theorem 2.26]) with the parameters 

£-~2rN^ and \:=rR^Ni 

to the lower semicontinuous and bounded from below function (^(z) + 5{z\ W) on and find in this way 
zq € W such that ||zo — z|| < A and that zq minimizes the perturbed function 

(p{z) + /3||z - zoll + S{z; W) on ze X^ with P ■= ^ = ? i - (4.6) 

A R2N i 



By the imposed growth condition N ^ — o{R) as r | we have 



e = 2rNi = r • o(i?3) < r ■ o(^-^ < r • o(^-^ 0, 

A _ rR^Nl _ Ni 
Ib-^ Rr " ^Rf ^ ' 

2N 2Ni ^/iVi\5 



Np = -^-^ = = 2 — ^ as r i 0. 

RiNi R^ ^ R ^ 

Thus A = o{Rr) and /3 J, as r | for the quantity /3 defined in (14. 6p . Taking into account that the function 
v(') + /^ll ■ ~-^oll is obviously Lipschitz continuous around z, we apply to this sum the subdifferential 
fuzzy sum rule from (Bl Lemma 2.32]. This allows us to find, for any given number 7^ > 0, elements 
-21 = (yij • ■ • 1 Un) G Zq + rjJB and Z2 = {xi, . . . , xn) G zq + rjlB such that 

\ip{zi) + f3\\zi - Zoll - <y9(zo)| < r?, Z2 e V7, and (4.7) 

0e9(</7(-)+/3|| •-zo||)(zi)+iV(z2;W^)+7/iB*. (4.8) 
Our next step is to explore formula (|4.8p . Since (y9(zo) > 0, we choose 



Then it follows from (|i?71) that 

</'(^o) _ (^(20) 



|(p(zi)-^(zo)| < (1 + /3)?7 < (1 + /3) 



2(1 + /3) 
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which imphes that (p{zi) —: a > 0. It is easy to see that the function (p{-) in (|4.4p is convex. Applying the 
Moreau-Rockafellar theorem of convex analysis gives us 

d(ip{-) + I3\\ ■ -zoll) (^i) - Mzi) + I31B*, (4.9) 

where the Frechet subdifferentials on both sides of (|4.9I) reduce to the classical subdifferential of convex 
functions. By the structure of (p in (|4.4I) and that of zi we have 

/ N 

Denote further yi — ai — i/i + for i — 2, . . . , N and observe that a — (p{zi) — J^iL-z llCilP j • Since 
the square root function is smooth at nonzero point, we apply the chain rule of convex analysis to derive 
that any element (yl, . . . ,?/^) G d(p{zi) has the representation 

I if 6 = 0, 

and y1 = — 2/2 ~ 1/3 ~ • • • ~ Z/^V' where u* G d\\ ■ \\ (^i) is a subgradient of the norm function calculated at the 
nonzero point £,i; hence = 1. This yields that 

M\\' + --- + \\yN\\'^^ and ||y*||2 + ... + ||y^||2>l. 

On the other hand, we have the estimates 

112:2 - z\\ < \z2 - zoll + 11^0 - z|| < 7] + A < 2A = o{Rr) 

for Z2 — (2^1, . . . , xjq) and hence \\xi — x\\ < \\z2^ z\\ — o{Rr) for i — 1, . . . ^ N. The latter ensures that each 
component Xi lies in the interior of the ball B{x, {R ~ I)?')- Furthermore, it follows from the structure of 
W in (14.51) and the product formula for Frechet normals that 

N{z2; W) = N{z2; 0i x . . . x 0^) = N{xu&i) x . . . x N{xn; 0n), 

which implies by combining with (|4.8I) and (14.91) the existence of {yl, . . . ,y'^) G d(p{zi) satisfying 

Oey* + Nix^; 0,) + 2/318*, \\x^ - 5|| < 2A ^ as r i 0, 
yl + ... + y*N ^0, and \\yl\\^ + . . . + \\y*^f > 1. 

Finally, replace y* by —y* and get from the above that 

y* e N{xf, 0,) + 2(318*, \\x^ - x\\ < 2A ^ 0, 

for i^l,...,N, as r 1 0, 

yl + ... + y*^^0, and \\ylf + ... + \\y*^\\^>l, 

which gives all the relationships of the rated extremal principle and completes the proof of the theorem. □ 

From the proof above we can distill some quantitative estimates for the elements involved in the 
relationships of the rated extremal principle. 

Remark 4.7 (Quantitative estimates in the rated extremal principle). The proof of Theorem l4.6l essentiallv 
uses the growth assumptions N^/^ = o{R) and i? < ^ on rated extremal points. Observe in fact that the 
given proof allows us to make the following quantitative conclusions: For any e > there exist a number 
r € (0,e), an index subset / — {ji, . . . , jat} with N"^^^ — o{R{r)), and elements 

y* G N{xf, 0,) with \\x^ - x\\ < 2rR^Ni for all i^I 
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satisfying the relationships 

\\yl+... + V*J<2Np^^ and Wy^f + . . . + \\y*J^ > I. 

Similar but somewhat different quantitative statement can be also made: For any rated extremal point x 
of the system {0i}i^T with a rate function R{r) = 0{r) there is a constant C > such that whenever 
e > there exist a number r e (0, e), an index subset / — {ji, . . . , Jat} with N^^^ ~ o{^), and elements 

y* e N{xi;0i) with \\xi - x\\ < cVrN^ for all ie I 

satisfying the estimates 

\\y*, + --. + y;j<cV7Ni and \\ylf + ... + \\ylf>l. 



In the last part of this section we introduce and study a certain notion of perturbed extremality for arbi- 
trary (finite or infinite) set systems and compare it, in particular, with the notion of linear subextremality 
known for systems of two sets. Given two sets 0i, 02 C X, the number 

i?(0i, 02) sup {ly > 0| J/B C 01 - 02} 

is known as the measure of overlapping for these sets 0. We say that the system {0i,02} is linear 
subextremal [9l Subsection 5.4.1] around x if 

i}([0i - xi] n rB, [02 - X2] n rB) 

^Hn{0i,02,x) -.^ liminf ^ ^ = 0, (4.10) 

0, 02_ r 

which is called "weak stationarity" in [5]; see OIH] for more discussions and references. It is proved in [5] 
and [HI Theorem 5.88] that the linear subextremality of a closed set system {0i, 02} around x is equivalent, 
in the Asplund space setting, to the validity of the approximate extremal principle for {0i, 02} at x. 

Our goal in what follows is to define a perturbed version of rated extremality, which is applied to 
infinite set systems while extends linear subextremality for systems of two sets as well. Given an i?-rated 
extremal system of sets {0i}ieT from Definition 14.11 we get that for any e > there are r — sup||ai||, 
R — R{r), and I C T satisfying 

f]{0,-x-a,)nirR)B ^d). (4.11) 

Let us now perturb ()4.11|) by replacing x with some Xi G 0inB^(x) and arrive at the following construction. 

Definition 4.8 (Perturbed extremal systems). Let {0i}igT be a system of nonempty sets in X , and let 
X e P|jgj,0i. We say that x is i?-PERTURBED extremal point of {0i,i G T} if for any e > there exist 
r = supjgj llflill < e, / C T with = o{R), and Xi G 0; H B^{x) as i £ I such that 

fl (0, -X,- a,) n {rR)B = 0. (4.12) 

In this case we say that {0i}i(=T is an i?-PERTURBED EXTREMAL SYSTEM at x. 

The next proposition establishes a connection between linear subextremality and perturbed extremality 
for systems of two sets {0i, 02}- 

Proposition 4.9 (Perturbed extremality from linear subextremality). Let a set system {0i,02,a;} be 
linearly subextremal around x. Then it is an R-perturbed extremal system at this point. 
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Proof. Employing the definition of linear subextremality, for any e > sufficiently small we find 
e 0i n Be (x) and r' < e such that 

i?([0i - xi] n r'B, [02 - X2] n r'B) < r'e. 

This implies the existence of a vector a € X satisfying ||a|| < r'e and 

a ^ ([01 - n r'lB^ - ([02 - X2] n r'is) , 

which ensures in turn that 

([01 - xi] n r'B - I) n ([02 - X2] n r'B + 
Let us show that the latter implies the fulfillment of 



(4.13) 



&2-X2 + - 



n-iB = 0. 



(4.14) 



Indeed, suppose that (|4.14l) does not hold and pick ^ e X from the left-hand side set in (|4.14p . Since 
C + f G 01 - xi and ||^|| < ^, we have 



r' r'e r' r' , 

<— H < \ ==r' 

-2 2-2 2 



and consequently ^ € [0i — xi] n r' B — — . Similarly we get G [02 — X2] H r'B — — . This clearly contradicts 
(|4.13p and thus justifies the claimed relationship (|4.14p . 

By setting r :— '^^^i out remaining task is to construct a continuous function : IR+ — > 
R{r) —7- 00 as r 4- and that for each e > there is r < e satisfying 



such that 



01-X1-- 



n 



02 - a;2 + - 



n {rR)B 



We first construct such a hmction along a sequence J, as fc — t- cx). Picking Sk i 0, find < Sk and 



select ttk E X with ||afe|| < r'f^Sk such that the sequence of ||afe|| is decreasing. Then define 



and 



R{£k) 



1 



It follows from the constructions above that 



rkR{rk) < r'kEk— = r'^, k E W. 

Sk 

We clearly see that the sequence {R{rk)} is increasing as | 0. Extending R{-) piecewise linearly to M+ 
brings us to the framework of Definition 14.81 and thus completes the proof of the proposition. □ 

Finally in this section, we show the rated extremality conditions of Definition 14.31 holds for i?-perturbed 
extremal points of infinite set systems from Definition 14.81 

Theorem 4.10 (Rated Extremal Principle for Perturbed Systems). Let x be an R-perturbed extremal point 
of a closed set system {0i}ieT in cin Asplund space X . Then the rated extremal principle holds for this 
system at x. 

Proof. Fix e > and find /, {xi}i^j, and {ai}i^i from Definition 14.81 such that 

fl (0, - X, - a,) n irR)B ^ 0. 

For convenience denote / := {1, . . . , N} and define 

:= |(ui,...,UA,) eX^ Ui£0,n (xi+rRB), i G /|. 
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For any z = (ui, . . . ,U]y) e consider the function 



N 1 



(p{z) = (^||ai -a,||^)' < 2rVN < inf ^3(2) + 2rAri 



1=2 

Furthermore, for z = (xi, . . . , xat) we have the estimates 

N 

llfli - aA\^] < 2ry/N < 

i=2 

The rest of the proof follows the arguments in the proof of Theorem 14.61 □ 

5 Calculus Rules for Rated Normals to Infinite Intersections 

In the concluding section of the paper we apply the rated extremal principle of Section 4 to deriving 
some calculus rules for general normals to infinite set intersections, which are closely related to necessary 
optimality conditions in problems of semi-infinite and infinite programming. Unless otherwise stated, the 
spaces below are Asplund and the sets under consideration are closed around reference points. As in 
Section 4, we often drop the subscript "r" for simplicity in the notation of rate functions Rr = R{r) if no 
confusion arises. In addition, we always assume that rate functions are continuous. 

We start with the following definition of rated normals to set intersections. 

Definition 5.1 (Rated normals to set intersection). Let p|,-gy 0^, and let x € 0. We say that a 
dual element x* G X* is an _R-NORMAL to the set intersection if for any r J, there is I ^ I{r) d T of 
cardinality = o{Rr) such that 

{x* ,x - x) - r\\x ~ x\\ <r for all a; G Q 0i n ri?^)- (5.1) 

The next proposition reveals relationships between Frechet and i?-normals to set intersections. 

Proposition 5.2 (Rated normals versus Frechet normals to set intersections). Let x £ — Hie/ 0i- Then 
any R-normal to at x is a Frechet normal to at x. The converse holds if L is finite. 

Proof. Assume x* is an _R-normal to at a; with some rate function R{r) while x* is not a Frechet 
normal to at this point. Hence there are 6 > and a sequence Xk x such that 6\\xk — < {x*,Xk — x) 
for all fc G JV. Hence Xk 7^ x and 

5\\xk - x\\ < {x*,Xk - x) < r\\xk - x\\+r 

whenever ||a;fc — a;|| < rR. Now suppose that rR — M > for some M and then fix a number k £ IN such 
that Ijxfc — a;|| < rR. Letting r J, 0, we arrive at the contradiction S\\xk — x\\ < 0. 

Consider next the remaining case when rR — as r | and find > sufficiently small so that 
\\xk — x\\ = rkR{rk) due to the continuity of R and the convergence rR — > 0. It follows that 

5rkR{rk) < rlR{rk) + ru and hence 5 <rk + ^ , fc G IV, 

which gives a contradiction as fc — > 00. Thus x* is a Frechet normal to at x. 

Conversely, assume that the index set / is finite, i.e., / = {1, . . . , A^}, and that x* is a Frechet normal. 
Then for any r > we have by (|2.1|) that 

N 



{x*,x-x) -r\\x-x\\<0 for aU x G Q 0i n C/, 
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where C/ is a neighborhood of x. This clearly implies (|5.ip with any rate function i?, which ensures that 
X* is an i?-normal to at x and thus completes the proof of the proposition. □ 

The next example concerns infinite systems of convex sets in . It illustrates the way of computing 
i?-normals to infinite intersections and shows that i?-normals in this case reduce to usual ones. 

Example 5.3 (Rated normals for infinite systems). Let m > 4 be a fixed integer. Consider an infinite 
system of convex sets {&k\keiN in defined as the epigraphs of the convex and smooth functions 

, ^ f/c™a;2 for x > 0, 
[0 for a; < 0, 

Let X (0,0), := (X^^i&k, and let R = R{r) = r"-'^ for some a e (0,^). We obviously get 
= ]R_ X M+ and N{x] 0) = K+ x R_. Let us verify that x* = (1,0) is an i?-normal to at 5, which 
implies the whole normal cone N{x] 0) consists of i?-normals. 

To proceed, fix any r > sufficiently small and denote by ko the smallest integer such that 

max I -i- , \ \ = \ < feS". 



l/m 1 

+ 1< 



2 + c 

r m 



Now consider /:={l,...,fco} and check that 
Since 1 - ^{2 + a) - a > 1 - |(2 + a) - a > i - > 0, it follows that 

17-13/2 1-a 

< = ri-5lr(2+")-" ^ when r i 0. 

Defining further 0o := HfeLi it remains to show that 

{x\x)-r\\x\\<r for all a; G 0o H B(0; ri?). (5.2) 



To verify (15.21) . take x := (i, s) and consider only the case when t > 0, since the other case of t < is 
obvious. For i > we have s > kj^t^ and 

{x\x)-r\\x\\ = t - r + s"^ <t(l-r'^l + k^^^t^^ < t(l - rfc™t) ^ -rkJJH^ + t =: f{t). (5.3) 

It follows from ||a;|| < rR — r" that 

r" > Vt^ + s2 > t^Jl + kl'^'t^ > k^t^ 

a 1/2 

and hence t < {-^) ■ The latter implies that for all x — {t, s) e 0o n B{0; rR) with i > we have 

/ r" \ 1/2 1 

{x*,x) ^r\\x\\ < fit) <supf{t) witha:={— > TTT^- 



Observe finally that the function f{t) in (|5.3p attains its maximum on [0,a] at the point t — and that 

sup/(t) = -rk,^^ + = _1_ < 

Combining all the above, we arrive at ()5.2p and thus achieve our goals in this example. 



The next example related to the previous one involves the notion of equicontinuity for systems of 
mappings. Given f^: X ^ Y , i G T, we say that the system {fi}i^T is equicontinuous at x if for any £ > 
there is 5 > such that |j/i(a;) — fi{x)\\ < e for all x € B{x,6) and i £T. This notion has been recently 
exploited in [IS] in the framework of variational analysis; see Remark 15.141 
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Example 5.4 (Non-equicontimiity of gradient and normal systems). Given an integer m > 4, define an 
infinite systems of functions (/Jfc : M for k E IN hy 

ik^-xl - xi for XX > 0, 
ipk[xi,X2) -.^ < (5.4) 
[—2:2 tor xi < (J. 

It is easy to check that the system of gradients {y^k}ke]N is not equicontinuous at x — (0,0). 
Furthermore, observe that the sets 0^. in Example 15.31 can be defined by 

0fc := {x e R2| (^fc(a;) < 0}, k e N. (5.5) 

Given any boundary point (xi,X2) of the set 0k, we compute the unit normal vector to 0k at {xi,X2) by 

^ =(2F"a;i,-l) for xi > 0, 



(0,-1) for xi < 0. 



and then check the relationships for xi > 0: 

\Mxi,X2)'U0,0)r^ \k2Zi + l as fc^oo. 

The latter means that the system of {S,k}keiN is not equicontinuous at a; = (0, 0). 



The next major result of this paper establishes a certain "fuzzy" intersection rule for rated normals 
to infinite set intersections. Its proof is based on the rated extremal principle for infinite set systems 
obtained above in Theorem 14.61 Parts of this proof are similar to deriving a fuzzy sum rule for Frechet 
normals to intersections of two sets in Asplund spaces given in [12] and in [8j Lemma 3.1] on the base of 
the approximate extremal principle for such set systems. 

Theorem 5.5 (Fuzzy intersection rule for i?-normals). Let x ^ :— f]^^rp0i, and let x* e X* be an 
R-normal to at x. Then for any e > there exist an index subset I, Frechet normals x* € N{xi;0i) 
with 1 1 — ill < e for i d I, and a number A > such that 

\x*^^x*+eB* and \^ + X^\\x*f + ^\\x*f ^l. (5.6) 

Proof. Without loss of generality, assume that a; = 0. Pick any x* E N{0; 0) and by Definition 15.11 
for any r > sufficiently small find an index subset |/|^/^ — o{R) such that 

{x*,x) - r\\x\\ < r whenever x € Q 0^ n (rR)B. (5.7) 

Then we form the following closed subsets of the Asplund space X x R: 

Oi := |(x,q) eXxM xe0i, a< (x*,x) - r||x|||, 
0^ := 0^ X M+ for i G / \ {1}, 
where / = {1, . . . , N} with "1" denoting the first element of / for simplicity. This leads us to 



(5.8) 



{Oi - (0, r)) n Pi n {rRr)B = 0. (5.9) 

Indeed, if on the contrary ()5.9p does not hold, we get {x,a) from the above intersection satisfying a > 0, 
X e flie/ 0i ^ {£Re)lB, and 

r < a + r < {x* ,x) — ?'||.t||. 
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where the latter is due to {x,a + r) E Oi. This clearly contradicts (|5.7p and so justifies (15.91) . Thus we 
have that (0,0) G X x R is a rated extremal point of the set system {Oi,02} from (|5.8|) in the sense of 
Definition 14.11 Applying to this system the rated extremal principle from Theorem 14.61 with taking into 
account Remark 14. 71 to find elements (wi, a^) and {x*Xi) for i = 1, . . . , N satisfying the relationships 



{x*,X,) E N{{w^,a^);0^), \\{w„ a,)\\ < 2rRi Ni , ^ G /, 

77 1 as r I 0, 



< 



(xt, Ai) + . . . + (a;^,AAr) 
UxI,XiW + --- + \\{x*n,Xn) 



(5.10) 



1. 



By the structure of as i = 1, . . . , iV we have from the first line of (I5.10p that x* G N{wi] 0i), that Ai < 
for i = 2, . . . , A^, and that 



{xl,x-wi) +Xi{a~ai) 

hm sup 1 1 < 

o, ^ ||x - Will + |a- ail 



(5.11) 



by the definition of Frechet normals. It also follows from the structure of Oi that Ai > and 

ai < (a;*,wi) -r||wi||. (5.12) 
This allows us to split the situation into the follows two cases. 

Case 1: Ai = 0. If inequality (|5.12p is strict in this case, there is a neighborhood W of wi such that 

ai < (x*,x) - r||a;|| for ah xeQiCiW. 
This implies that {x, ai) G Oi whenever a; G 0i n W. Substituting {x, ai) into (|5.1ip gives us 

{xl,x- wi) 



lim sup ■ 

x—^wi 



\X- Wl\ 



< 0, i.e., xl G N{wi;0i). 



If (|5.12l) holds as equality, we denote a := (x*, x) — r||.T|l and get 
|q! - ail 

which implies by (|5.1ip that 



x*,x-«;i)+r(||u;i||-||x||)| < (||x*|| + r) ||x - «;i||, 
{xl,x- Wi) 



lim sup 



< 0. 



, ,Oj. \\x-wi\ 



|a - ai| 

Thus it follows for any e' > sufficiently small and the number a chosen above that 

{xl,x- wi) < s'(^\\x - Will + |a - ail) < e' (^1 + \\x*\\ +r^\\x - Wi\\ 
for all X G 01 sufficiently closed to Wi. This ensures that 

limsup-^^ii^^-^ < 0, i.e., xjGiV(wi;0i) 



X — Wi 



when (|5.12p holds as equality as well as the strict inequality. Since Ai = in Case 1 under consideration 
and since A; < for alH > 2, it follows that 



A2 + . . . + A^ < (A2 + . . . + Ajv)2 < ,y2 



This leads us to the estimates 



> 1 - (A2 + . . . + A^,) > -, 



and thus we get from (|5.10p all the conclusion of the theorem with A = in (|5.6p in this case. 
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Case 2: Ai > 0. If inequality (|5.12p is strict in this case, put x wi and get from (|5.11|) that 

hmsup ^ii^^ — ^^il < 0, 
Q_>Qi |a — ai| 

which yields Ai = 0, a contradiction. It remains therefore to consider the case when ()5.12p holds as equality. 
Take then a pair (x, a) G Oi with 

a; e 01 \ {wi} and a = {x*,x) — r\\x\\ 

and hence get from (|5.12p that 

a-ai = {x*,x- wi) + r{\\wi\\ - \\x\\), 

which implies the relationships 

(x*, a; — wi) + Ai(a — ai) — (x* + Xix* ,x — wi) + Air(||u;i|| — ||x||), 

|a - ail < (||x*|| + r)\\x - wi\\. 

On the other hand, it follows from (|5.11l) that for any e' > sufficiently small there exists a neighborhood 
V of wi such that 

{xl,x — wi) + Ai(a — ai) < AieV^||x — wi\\ + \a ~ ai\j , 
whenever x G 0i DV and that 

{xl + Xix* , X — Wi) + Air(||wi|| - ||x||) < Ai£V(||x — + ja — q;i|) 

< AieV ||x — Will + (||x*|| + r)||x — wi| 
AieV(l + ||x*|| + r)||x - wi||. 

Let us now choose e' > sufficiently small so that 

(x* + Aix*,x - wi) + Air(||wi|| - ||x||) < Air||x - wi\\. 
and for all X e 01 n y get the estimate 

(x^ + Aix*,x — wi) < Ai7-||x — Will + Ai7'(||x|| — ||wi||) < 2Air||x — wi||. 
It follows definition (12. ip of e-normals that 

xl+XiX* e ^2Air(wi;0l), 

where Ai < 1 by the third line of (|5.10p . Using the representation of e-normals in Asplund spaces from [5J 
(2.51)], we find i; G 0i n (wi + 2Xir)B) such that 

x^ + Aix* e N{v; 0i) + 2XirB*. 

Hence ||w|| < ||i; - wi|| + ||7«i|| < 2Air + 2rR^N'i < SrR^N^ and there is x| e N{v; 0i) with 

Aix* €z Xi — xl + 2XirlB* . 

Taking into account that x^ + . . . + x^ G V^* : g^t 

Aix* exl+xl + ... + x*j^ + (2Air + t])B*. 

On the other hand, it follows from — x^ = Aix* —xl — u* with some ||w*|| < 2Air < 2r that 

11:^111' < (Ai||x*|| + PJII +2r)' < 2Xl\\x*f + 2\\xlf + ^. 
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Moreover, since |Ai + A2 + ... + AAr| <77|Oasr|Oby the second hne of (|5.10p and since Ai > while 
Xi < for i — 2, . . . , N , we have 

77^ > A^ + (A2 + . . . + Xn? + 2Ai(A2 + . . . + Aat) > A^ + (A2 + . . . + AAr)^ + 2Ai(-Ai - rj) 

It also follows from (|5.10p and < Ai < 1 that 



A? > (A2 + . . . Xn^ -V^ - 2r]Xi >Xl + ... + X% 
which leads us to the subsequent estimates 

Xl + ... + X% <2Xl + ^ and 



l<{Xi + ... + Xi,) + {\\xlf + ... + \\x%f 



2 t r,\2|i *||2 I oll™*l|2 I /ll™*l|2 I I ||2 



<2Af + 2Af||a;*|r + 2||£J 

This finally ensures that 



\<xi+xi\\x*r+\\x:r + \\x*r+...+\\x},r 

and brings us to all the conclusions of the theorem with A := Ai in (|5.6p . □ 

Remark 5.6 (Quantitative estimates in the intersection rule). It can be observed directly from the proof 
of Theorem 15.51 that we get in fact the following quantitative estimates in intersection rule obtained for 
infinite set systems when r > — is sufficiently small: = o{R), 

\\x,~x\\ <3rR^\I\T, and Xx* e x* + (2r + A^-^) B* . 
In particular, for R — 0(i), there is C > such that aU the conclusions hold with — N'^/'^ = "(i), 



< cVrTVi, and Aa;* G ^ x* + cVrN^B* 



iei 

Remark 5.7 (Perturbed rated normals to infinite intersections). Inspired by our consideration of perturbed 
extremal systems in Section 4, we define a perturbed version of i?-normals to infinite set intersections as 
follows: X* G X* is a perturbed R-normal to the intersection := HisT 0i at a; G if for any e > there 
exist a number r > 0, an index subset / with cardinality = o{Rr), and points Xi G 0i n B{x,e) as 

i £ I such that r\I\ < e and 

{x*,x) — r\\x\\ < r whenever a; G (0i — 3;^) n {rRr)B. 

iei 

Then the corresponding version of the intersection rule from Theorem 15.51 can be derived for perturbed 
rated normals to infinite intersections by a similar way with replacing in the proof the rated extremal 
principle from Theorem 14.61 by its perturbed version from Theorem 14.101 

We proceed with deriving calculus rules for the so-called limiting R-normals (defined below) to infinite 
intersections of sets. First we propose a new qualification conditions for infinite systems. 

Definition 5.8 (Approximate qualification condition). We say that a system of sets {0i\ieT C X satisfies 
the APPROXIMATE QUALIFICATION CONDITION (AQC) at X £ PlieT 0« for any e I 0, any finite index 
subset C T , and any Frechet normals x*^ G N{xif,] &i) H B* with lla;^^ — x|| < £ as i G the following 
implication holds: 

||^<,||in0=^5:i|<,f i^O. (5.13) 
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The next proposition presents verifiable conditions ensuring the vahdity of AQC for finite systems of 
sets under the SNC property p.l3|) discussed at the end of Section 3; see [8] for more details. 

Proposition 5.9 (AQC for finite set systems under SNC assumptions). Let {0i,...,0m} be a finite 
set system satisfying the limiting qualification condition at x £ CiiLi ®i- foT any sequences Xik — ^ x and 
x*f. ^ X* with x*f. e N{xik] 0i) as k CO and i — 1, . . . ,m we have 

W^ik + ■ • ■ + a^mfcll xl — . . . — x"^ — 0, 

which is automatic under the normal qualification condition via the basic normal cone (j2.2p ; 

[a;J + . . . + a;*„ = and x* £ N{x; 0,;), i — 1, . . . ,m\ x* = for all i = 1, . . . , m. 

Assume in addition that all but one of 0i are SNC at x. Then the AQC is satisfied for {0i, . . . , 0m} at x. 

Proof. Pick £fe I 0, x*f. £ N{xik\ &i) n ]B* , \\xik — a;|| < £fc as i = 1, . . . , m and assume that 

\\xlk + ■■■ + <«fcll ^0 as fc ^ oo. (5.14) 

Taking into account that the sequences {x*^.} C X* are bounded when X is Asplund, we extract from 

them weak* convergent subsequences and suppose with no relabeling that a;*^, ^ a;* as fc — )■ oo for all 
i — I, . . . ,m. It follows from the imposed limiting qualification condition for {0i,...,0m} at x that 
xl = . . . = x*j^ = 0. Since all but one (say for i = 1) of the sets 0i are SNC at x, we have that ||a;*j,|| -> 
as fc cx) for i = 2, . . . , m. Then (|5.14l) implies that \\xli^\\ — > as well, which verifies implication (|5.13p 
and thus completes the proof of the proposition. □ 

The following example illustrates the validity of the AQC for infinite systems of sets. 



Example 5.10 (AQC for infinite systems). We verify that the AQC holds in the framework of Example 
at the origin x = (0, 0) G M^. Recall that for each k £ IN the normal cone to a convex set 0k from (|5.5 
at a boundary point x — (xi, X2) is computed by 



N{x;0k) = R+^kix) with Ck{x) = ^(3^1,2:2) 



(2fc™xi,-l) forxi>0, 
(0,-1) fora;i<0. 



If according to the left-hand side of (|5.13p we have 

Kk^k{Xek) 



as £ 4- 0, 



then it follows from the above representation of ^k that its component goes to zero as k 00. Thus 

which verifies the AQC property of the system {0k}k€iN at x. 

Now we are ready to define limiting _R-normals and derive infinite intersection rules for them. In the 
definition below Rk stands for a rate function for each x^; these functions may be different from each other. 

Definition 5.11 (Limiting i?- normals to infinite set intersections). Consider an arbitrary set system 
{0i}ieT C X, and let :— HigT with x £ 0. We say that a dual element x* is a LIMITING R- 

NORMAL to at X if there exist sequences {{xk, xl)}ke]N C X x X* such that Xk ^ x, x^ x* as 
fc — >■ 00 and that each element xt is an Rk-normal to at Xk, 
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It is clear from the definition and ProDOsition l5.2l that any limiting i?-normal is a basic/limiting normal 
to at a;. Conversely, if T is a finite index set and X is an Asplund space, then we the reverse implication 
holds, i.e., any limiting/basic normal is a limiting i?- normal. 

The next theorem provides a representation of limiting i?-normals to infinite set intersections via 
Frechet normals to each set under consideration. In particular, it implies a useful calculus rule for the 
basic normal cone (|2.2p to infinite intersections. 

Theorem 5.12 (Representation of limiting i?-normals to infinite intersections). Let :— Cl^^x^i with 
a; e for the system {0i}igT C X satisfying the AQC property from Definition \b.8\ at x. Then for any 
given limiting R-normal to & at x and any e > we have the inclusion 

e cl*{^a;* +e-B* x* £ N{x,]0i), \\xi-x\\ < e, / C t}, 
iei 

where I d T is a finite index subset. In particular, if all the limiting/basic normals to at x are limiting 
R-normals in this setting, then 

N(x;0) C f]c\*{^x* +elB* x* e iV(x,; 0,), ||a;, - x|| < e, / C t}. (5.15) 

Proof. Take a sequence {x^} of i?-normals to at Xk with — >■ x and x^. ^ x* as fc — > oo. The 
latter convergence ensures by the Uniform Boundedness Principle that the set {||a;fe||}fcew is bounded in 
X*. Picking e > sufficiently small, we find Xfc S with \\xk — x|| < e. Applying Theorem 15.51 to x^ for 
each k £ IN gives us sequences x*j, G N{xik\ 0i) with ||xifc — Xk\\ < e ior i £ Ik C T and Xk > satisfying 

XkX*keY.x*, +sIB* and \l + Xl\\xlf + Y, W^^kf = k & IN- (5.16) 

ie/fc leik 

Let us show that the sequence {Xk} is bounded away from 0. Assuming on the contrary J, as fc — ^ oo, 
we have 



E 



as fc — > oo 



from the inclusion in (|5.16|) . Then the imposed AQC leads us to 

^Mkf^O as fc^oo, 

iG/fc 

which contradicts the equality in (|5.16p and thus shows that there is constant C > with Xk > C for all 
k £ IN sufficiently large. Rescaling finally the inclusion in (|5.16l) . we get 

iei 

which ensures that x^ x* as fc oo and thus justifies the first conclusion of the theorem. The second 
ones on basic normals follows immediately. □ 

The next corollary provides more explicit results for the case of infinite systems of cones, with the 
replacement of Frechet normals in Theorem 15.121 by basic normals at the origin. 

Corollary 5.13 (Limiting i?-normals to intersection of cones). Let {Aij^gT be a system of cones in X, 
and let A := pl^^^ A^. Suppose that x* G X* is a limiting R-normal to A at the origin and that the AQC 
property from Definition \5.8\ holds at x = 0. Then for any s > we have the representation 



X* e cl*{^x* +eiB* X* e iV(0;A,), /c r} 
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via finite index subsets I dT. If furthermore all the limiting/basic normals to A at the original are limiting 
R-normals in this setting, then 



iV(0;A)c f]cl*[j2x:+eB* 



X, 



:* eiV(0;AO, /ct} 



e>0 ie/ 



Proof. It is not hard to check that N{wi;Ai) C iV(0; A^) for any cone A.; and any Wi G A^; see, e.g., 



[lOl Proposition 2.1]. Then we have both conclusions of the corollary from Theorem 15. 121 □ 



Remark 5.14 (Comparison with known resuhs). For the case of finite set systems the intersection rules 
of Theorems 15.51 and 15.121 go back to the well-known results of [8]. In fact, not much has been known 
for representations of generalized normals to infinite intersections. Our previous results in this direction 
obtained in [101 111) , obtained on the base of the tangential extremal principle in finite dimensions, have a 
different nature and do not generally reduce to those in [8 for finite set systems. 

An interesting representation of the basic normal cone (12.21) has been recently established in flM 
Theorem 3.1] for infinite intersections of sets given by inequality constraints with smooth functions. This 
result essentially exploits specific features of the sets and functions under consideration and imposes certain 
assumptions, which are not required by our Theorem 15.121 In particular, [15, Theorem 3.1] requires the 
equicontinuity of the constraint functions involved, which is not the case of our Theorem 15.121 as shown 
in Examples 15.31 and 15.41 Note to this end that all the limiting normals are limiting i?- normals in the 
framework of Example 15.31 and that the AQC assumption is satisfied therein; see Example 15.101 

We finish the paper with deriving necessary optimality conditions for problems of semi-infinite and 
infinite programming with geometric constraints given by 



with a general cost function (/?: AT — >■ R and constraints sets 0t C X indexed by an arbitrary (possibly 
infinite) set T. We refer the reader to [2j[4l[Tl] and the bibliographies therein for various results, discussions, 
and examples concerning optimization problems of type (I5.17|) and their specifications. The limiting normal 
cone representation (|5.15p for infinite set intersections in Thcorcm l5.121 combined with some basic principles 
in constrained optimization, leads us to necessary optimality conditions for local optimal solutions to ()5.17p 
expressed via its initial data. 

The next theorem contains results of this kind in both lower subdifferential and upper subdifferential 
forms; see [S] Chapter 5] for general frameworks of constrained optimization and [2i for semi- infinite/infinite 
programs with linear inequality constraints in (I5.17p . The lower subdifferential condition is given below 
for the case of locally Lipschitzian cost functions on Asplund spaces via the construction 



known as the Mordukhovich/basic/limiting subdifferential of (p at x; see [Tl 151 [T51 114] for more details and 
discussions. The upper subdifferential condition below employs the so-called Frechet upper subdifferen- 
tial/ superdifferential of if at this point defined by 



Theorem 5.15 (Necessary optimality condition for semi-infinite and infinite programs with general geo- 
metric constraints). Let x be a local optimal solution to problem (|5.17p . Assume that any basic normal to 
:= PliGT ®i o,t X is a limiting R-normal in this setting, and that the AQC requirements is satisfied for 
{0i}igT o^t X. Then the following conditions, involving finite index subsets I <ZT , hold: 
(i) For general cost functions Lp finite at x we have 



minimize ip{x) subject to a; e 0^, t £ T, 



(5.17) 



dip{x) := Jjimswp d(p{x) 



d+ 



fix) := -d{-(p){x). 



dipix)cif]cr{j2=^:+elB* 



X. 




(5.18) 



e>0 ie/ 
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(ii) // in addition ip is locally Lipschitzian around x, then 



e (9(^(S)+ Pi cl*|^x* +eiB* x*£N{x,-0,),\\x,-x\\<e,I^Ty (5.19) 





e>0 ' 16/ 



Proof. It follows from ^ Proposition 5.2] that 

-dLp{x)<zN{x]&)<zN{x]0) (5.20) 

for the general constrained optimization problem 

minimize Lp{x) subject to x S 0. (5.21) 

Employing now in (I5.20[) the intersection formula (|5.15p for basic normals to = we arrive at 

the upper subdifferential necessary optimality condition (|5.18p for problem (|5.17p . 

To justify (|5.19p . we get from ^ Propostion 5.3] the lower subdifferential necessary optimality condition 

e a</j(i) + iV(x; 0) (5.22) 

for problem (|5.21l) provided that ip is locally Lipschitzian around x. Using the intersection formula (|5.15p 
in (|5.22p completes the proof of the theorem. □ 
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